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MEMORY SYSTEM INCLUDING A MEMORY 

MODULE HAVING A MEMORY MODULE 
CONTROLLER INTERFACING BETWEEN A 
SYSTEM MEMORY CONTROLLER AND 
MEMORY DEVICES OF THE MEMORY 
MODULE 

RELATED APPLICATIONS 

This application is related to and claims the benefit of the 
filing dates of the following United States Provisional patent 
applications: (1) Provisional Application No. 60/067,824, 
entitled DISTRIBUTED CONTROL MEMORY BUS 
ARCHITECTURE, filed on Dec. 5, 1997iand(2)Provisioual 
Application No. 60/067,588, entitled DISTRIBUTED CON- 
TROL MEMORY BUS ARCHITECTURE, filed on Dec. 5, 
1 997 . These applications are assigned to the same assignee as 
the present application. 

This application is also related to U.S. patent appHcation 
Ser No. 09/023,234, entitled MEMORY MODULE 
INCLUDING A MEMORY MODULE CONTROLLER 
filed on Feb. 13, 1998» and U.S. patent appUcation Ser. No. 
09/023,172, entitled MEMORY MODULE CONTROLLER 
filed on Feh 13, 1998, each of which is assigned to the 
assignee of the present application. 

FIELD OF THE INVENTION 

The present invention pertains to the field of memory sys- 
tems. More particularly, the present invention relates to a 
memory system that includes a memory controller on a 
memory module. 

BACKGROUND 

Memory modules such as single in-line memory modules 
(SIMMs) and dual in-line memory modules (DIMMs) are 
typically used to store data, instructions, and other informa- 
tion in computers or other digital systems, FIG. I shows a 
typical memory system in which processor 102 communi- 
cates with dynamic random access memory (DRAM) devices 
110-H7 on memory modules 106 and 108, respectively, via 
memory controller 104. Memory controller 104 comm\mi- 
cates appropriate memory instructions (e.g., write, read, 
refi*esh, etc.) to memory module 106 via address and com- 
mand bus 118, and to memory module 108 via address and 
command bus 120. Data is transferred firom memory control- 
ler 104 to both modules via bus 122. 

There are at least two disadvantages associated with the 
conventional memory system of FIG. 1: (1) buses 118, 120, 
and 122 are muhi-drop buses that have high capacitiye loads 
which require large drivers in memory controller 104 and in 
DRAMS 1 10-1 17 (to drive bus 122); and (2) there tends to be 
large mismatches in loading between the address and com- 
mand buses and data bus 122. These disadvantages combine 
to reduce the maximum operating ficquency, increase power 
consumption, and decrease performance of the system. Addi- 
tionally, memory controller 104 may include a high niunber 
of pins (e.g., approximately 1 90 pins for a 4 DIMM SDRAM 
system) to support access to memory modules 106 and 108. 
The bus width of data bus 122 is often 64 or 72 bits wide to 
support larger bandwidths, for example, of up to 100 mega 
transmissions per second (MT/s), 

FIG. 2 shows another typical memory system that uses 
technology fiiom Rambus. Inc. of Mountain View, Calif. In 
this system, processor 202 conrniunicates with Rambus 
dynamic random access memory (RDRAM™) devices 
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2 10-217 on memory modules 206 and 208 (also called Ram- 
bus in-line memory modules or RIMM™ modules), respec- 
tively, via memory controller 204. Memory controller 204 
communicates appropriate memory instructions (e.g., write. 

5 read, refresh, etc.) and data in a time-multiplexed fashion to 
memory modules 206 and 208 via memory specific bus 226. 
Each of the RDRAM*^* devices 210-217 include interface 
logic 218-225. respectively, that enables the RDRAM^^ 
devices to interface to memory specific bus 226. Memory 

1 0 speci fic bus 2 26 may opera te at a high -frequency (e. g. , 250 to 
400 MHz), have a small bus width (e.g., 1 6 or 1 8 signal lines), 
have symmetric loading for address, command, and data 
information, and have a bandwidth of up to 800 MT/s. In other 
embodiments, the address and control information may be 

15 separated (demultiplexed) from the data bus in this environ- 
ment. 

The system of FIG, 2 has a number of disadvantages. Each 
RDRAM^w device includes a significant amount of logic in 
the interface logic which makes implementation of the 

20 RDRAM™ devices more difificult and more expensive than 
other DRAM devices, and which causes the RDRAMT^ 
devices to draw more power and dissipate more heat than if 
the logic was not present. This may lead to thermal and 
reliability problems. Additionally, each RDRAM™ typically 

25 includes a delay locked loop (DLL) circuit coupled to a plu- 
rality of clock signals on bus 226. The DLL circuits are 
typically always fimctioning and drawing significant 
amounts of power which contributes to thermal and rehability 
issues. Additionally, memory controller 204 must include 

30 relatively large drivers to drive bus 226. 

In each of the memory systems described in FIGS. 1 and 2, 
the memory controller must be designed to provide the appro- 
priate memory transactions to the memory devices in a pre- 
determined format and at predetermined times. The memory 

35 devices and memory controller must then be designed to work 
together. It would be advantageous to decouple the design of 
the memory devices and the memory controller such that 
independent advances may be made in each technology. It 
would also be desirable to decouple the operation of the 
memory devices from the memory controller to decrease 
power drawn by each memory device and by the entire 
memory system. 

Other features and advantages of the present invention will 
be apparent from the accompanying drawings and from the 
detailed description that follows. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The features and advantages of the present invention are 
illustrated by way of example and not limitation in the figures 
of the accompanying drawings in which like references indi- 
cate similar elements and in which: 

FIG. 1 is a block diagram of one embodiment of a conven- 
tioual memory system; 

FIG. 2 is a block diagram of another embodiment of a 
conventional memory system; 

FIG. 3 is a block diagram of one embodiment of a memory 
system according to the present invention; 

FIG. 4 is a block diagram of another embodiment of a 
memory system according to the present invention; 

FIG. 5 is a block diagram of one embodiment of a dynamic 
random access memory (DRAM) module including a DRAM 
memory module controller, 
65 FIG, 6 is a block diagram of one embodiment of a static 
random access memory (SRAM) module including an 
SRAM memory module controller. 
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FIG. 7 is a block diagram of one embodiment of nonvola- 
tile memory module including a nonvolatile memory module 
controller; 

FIG. 8 is a block diagram of one embodiment of the 
memory module controller of FIG. 3 coupled to a time mul- 
tiplexed system memory bus; 

FIG, 9 is a flow chart of one embodiment of tlie process 
implemented by the memory module controller of FIG. 8; 

FIG. 10 is a block diagram of one embodiment of the 
memory module controller of FIG. 3 coupled to a demulti- 
plexed system memory bus; 

HG. 11 is a flow chart of one embodiment of the process 
implemented by the memory module controller of FIG. 10; 

FIG. 12 is a block diagram of one embodiment of a 
memory module including a memory module controller inter- 
facing SDRAM devices with a system memory bus using a 
Direct Rambus'"^^ protocol; 

FIG, 13 is a flow chart of one embodiment of a read trans- 
action implemented by the memory module controller ofFIG. 
12; 

FIG. 14 is an exemplary timing diagram of the read trans- 
action implemented by the memory module controller ofFIG. 
12; 

FIG. 15 is a flow chart of one embodiment of a write 
transaction implemented by the memory module controller of 
FIG. 12; 

FIG. 16 is an exemplary timing diagram of the write trans- 
action implemented by the memory module controller ofFIG. 
12; 

FIG. 17 is an exemplary timing diagram of a read transac- 
tion implemented by the memory module controller ofFIG, 
12 using a modified protocol; and 

FIG. 18 is an exemplary timing diagram of a write trans- 
action implemented by the memory module controUerofFIG, 
12 using a modified protocol. 

SUMMARY OF THE INVENTION 

One embodiment of the present invention includes a sys- 
tem that has a system memory controller and a memory 
module. The memory module includes a memory module 
controller coupled to the system memory controller and a 
plurality of memory devices coupled to the memory module 
controller. 

Other objects, features, and advantages of Uie present 
invention will be apparent from the accompanying drawings 
and from the detailed description that follows. 

DETAILED DESCRIPTION 

A memory system including distributed control of memory 
devices on memory modules is described. The present inven- 
tion includes a memory module controller device on each 
memory module in the system. The memory module control- 
ler communicates with the system memory controller over a 
system memory bus and with the individual memory dievices 
at the module level. The system memory bus may be a low pin 
count, high frequency, multiplexed or demultiplexed bus. The 
memory module controller may communicate with the indi- 
vidual memory devices over wider, lower frequency, demul- 
tiplexed signals lines. As the system memory controller com- 
municates directly with only the memory module controllers, 
the loading on the system memory bus may be reduced and 
the size of the bus drivers in the system memory controller 
may also be reduced. 

The memory module controller on each memory module is 
the interface between the system memory controller and the 
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individual memory devices on the modules. This architecture 
decouples the individual memory devices from the system 
memory bus and the system memory controller. This may 
allow for the independent development of the memory device 

5 technology. For example, the memory devices may be devel- 
oped to be faster, wider, to operate at different operating 
supply voltages, or to operate with reduced voltage swings 
than if the memory devices where directly communicating 
with the system memory controller. 

10 The memory module may have its own memory address 
lines, control lines, and data lines between the memory mod- 
ule controller and the individual memory devices. The signal 
lines for these point-to-point or bus coimections may be sig- 
nificantly shorter than the system intercoimection buses used 

1 3 in conventional memory systems. This may allow for reduced 
loading, better control of capacitance on the address and data 
lines, and may increase the maximmn operating frequency of 
the module while reducing power drawn by the system. Addi- 
tionally, power may be further reduced by omitting DLLs 

20 from the individua t memory devices . A DLL may be included 
witliin tlie memory module controller if required for interfac- 
ing with the system memory bus, 

FIG. 3 is a block diagram of one embodiment of the present 
invention. System 300 includes processor 302, system 

25 memory controller 304, and memory modules 306 and 308, 
Processor 302 communicates with system memory controller 
304. Processor 302 may be any control logic or microproces- 
sor that commimicates write, read, and other memory trans- 
actions to system memory controller 304. System memory 

30 controller 304 communicates the memory transactions to 
memory module controllers 310 and 316 of memory modules 
306 and 308, respectively, via system memory bus 323. Sys- 
tem memory controller 304 may be part of a chip set for a 
personal computer, for example, or it may be other indepen- 

35 dent logic. 

Memory modules 306 and 308 may be SIMMs, DIMMs, 
RIMM"* modules, or any other type of memory modules. 
Each memory modiile includes a memory module controller 
and one or more memory devices. For example, memory 

40 module 306 includes memory module controller 310 and 
memory devices 312-315, and memory module 308 includes 
memory module controller 3 16 and memory devices 
317-320. The memory module controllers may be separate 
integrated circuits from the memory devices. AA^hile system 

45 300 is illustrated as including two. memory modules, any 
number of memory modules may be used. The memory 
devices may be placed on one side of the module, on both 
sides of the module, and/or they may be stacked on top of each 
other. The module may also be a multi-chip module. For one 

50 embodiment, a memory module may have an approximate 
height 350 of from 1 to 2 inches, and an approximate length 
352 of from 4 to 6 inches. 

Memory modules 310 and 316 conomtmicate memory 
transactions with system memory controller 304 via system 

55 memory bus 323. System memory bus 323 may be a low pin 
count (e.g., approximately 1 6 to 35 address, data and control 
signal lines) bus operating at a high frequency. For one 
embodiment, system memory bus 323 may operate at a fre- 
quency of approximately 200 to 500 MHz. Other frequencies 

60 may be used. System memory bus 323 includes a command/ 
adchiess bus 324 and a data bus 328. Conunand/address bus 
324 may time-multiplex commands and address information 
on one or more of the signal lines. The command and address 
bus 324 may also be split into separate conmaand and address 

65 buses as in SDRAMs. System memory bus 323 may option- 
ally include clock bus 322 that may carry one or more clock 
signals on the same or separate signal lines, and handshaking 
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bus 326 that may cany a handshaking signal between system 
memory controller 304 and memory module controllers 310 
and 3 16. The handshaking signal may be generated by system 
memory controller 304, for example, at the start of a memory 
request packet or when it is transmitting valid data on data bus 
328. The handshaking signal may be generated by memory 
module controllers 310 and 316 when they are providing 
valid data requested by system memory controller 304 to data 
bus 328. 

For one embodiment, system memory bus 323 may be 
compatible with the Direct Rambus™ bus architecture that 
includes 16 or 18 data bits on bus 328, one or more clock 
signals on bus 322, and command and address infonnation on 
bus 324. The clock signals for this embodiment may run at 
rates of appro?dmately 400 MHz enabling a data transmission 
rate of up to 800 MT/s. For this embodiment, system memory 
controller 304 may be any controller that may be able to 
implement the Direct Rambus'^ protocol for memory trans- 
actions on system memory bus 323. Additionally, system 
memory bus 323 may use Rambus Signaling Levels (RSL) for 
the signals transferred on the bus. For alternative embodi- 
ments, any other type of appropriate signaling levels may be 
used including TTL, CMOS, GTL, SSTL, CTT or other sig- 
naling levels. 

For another embodiment, system bus 323 may be one gen- 
eral purpose bias that carries time-multiplexed address, data, 
and control infonnation. For example, system bus 323 may be 
compatible with Concurrent and Base Rambus"^^ architec- 
tures. For these embodiments, system memory controller 304 
may be any controller that may be able to implement these 
protocols for memory transactions on system memory bus 
323. 

System memory bus 323 may be placed on a printed circuit 
board (PCB) that includes system memory controller 304 and 
interconnection slots for modules 306 and 308 as shown in 
FIG. 3. Alternatively, system memory bus 323 may be routed 
through separate channels of memory modules 306 and 308 
such as charmels 402, 404, 406, and 408 as shown in FIG. 4. 

Memory module controllers 310 and 316 operate as 
bridges between system memory bus 323, that operates in one 
protocol or format, and local or memory module buses (e.g.. 
lines 330, 332. and 334-337) that operate in a second differ- 
ent protocol or format. Each memory module includes control 
logic necessary to interpret the memory transaction on system 
memory bus 323 and translate that transaction into the appro- 
priate control, address, and data signals for its memory 
devices on the memory module. Similarly, the memory mod- 
ules interpret the memory transactions on the local or 
memory modiile bus into the format required to transmit the 
transaction to the system memory controller 304 via system 
memory bus 323. 

Memory module controllers 310 and 316 may also include 
circuitry necessary to perform refresh operations of dynamic 
memory devices, prefetch operations, error correction func- 
tions that may use, for example, ECC bits, current calibration 
if system memory bus 323 is a current bus, serial presence 
detect circuitry, a DLL circuit, power management circuitry 
that may shut off the clock signals or clock enable signals for 
the memory devices or provide other power down circuits, 
program and erasing voltages for nonvolatile memory cir- 
cuits, and/or levelizing circuitry to generate signals on system 
memory bus 323 in the appropriate clock domains (if there is 
more than one clock domain on system memory bus 323). 

Each memory device on the memory modules communi- 
cates memory transactions with its memory module control- 
ler via address, data, and control signals. Memory transac- 
tions are those transactions that are appropriate for each type 
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of memory device used. For example, the memory transac- 
tions may include write, read, refresh, prefetch, power down, 
reset, erase, and the like. Memory module 306, for example, 
may conamunicate memory addresses to memory devices 

^ 312-315 via signal lines 330, control information (e.g., chip 
enable signals, write enable signals, RAS, CAS, output 
enable signals, etc.) via signal lines 332, and data via point- 
to-point connections 334-337. Each of the signal lines 330, 
332, and 334-337 may be one or more signal lines. Signal 
lines 330 and 332 may be buses that connect to all four 
memory devices 312-315, to groups of memory devices (e.g., 
two at a time), or they may be point-to-point connections to 
memory module controller 310. Similarly, memory module 
308 may communicate memory addresses to memory devices 
317-320 via signal lines 338, control information via sigiial 
lines 340, and data via point-to-point connections 341-344. 
Each of the signal lines 338, 340, and 341-344 may be one or 
more signal lines. 

For one embodiment, the number of signal lines 334-337 
may be the same as the number of signal line carrying data for 
system memory bus 323. For another embodiment, the num- 
ber of signal lines 334-337 may be collectively greater than 
the number of signal lines carrying data from system memory 

2j controller 304 to memory module controller 310 on system 
memory bus 323 . Hiis may increase the bandwidth of the data 
transfer on the memory module. For example, system 
memory bus 323 may carry 16 data signals in parallel on bus 
328 and memory module controller 310 may simultaneously 
provide 16 data signals to each of memory devices 312-315. 
Because the data bus width may be wider (e.g., 64 or 72 bits 
wide) than that of system memory bus 323 (e.g.. 1 6 bits wide), 
memory module controller 310 may supply a clock signal on 
bus 330 to memory devices 312-315 that is a lower frequency 

2^ than that running on system memory bus 323. For one 
embodiment, the clock frequency on bus 330 may be approxi- 
mately 50 to 200 MHz, for example, when the frequency of 
the clock signal on clock bus 322 is approximately 1 00 to 400 
MHz. The frequency of the clock signal on clock bus 322 may 
also be double-pumped, that is, perform an action (e.g., load 
data) on each clock edge. 

By having local address, control, and data lines on the 
memory modules which are decoupled from system bus 323, 
the length of these signals may be reduced over those on the 

45 system memory bus, the loading of these lines may be 
reduced over that of the system memory, and the loading may 
be more accurately controlled between the different lines so 
as to more closely achieve symmetric loading between the 
signals lines. For example, the loading on the data lines and 

50 the address and control lines may have approximately the 
same loading (e.g., approximately 10 to 40 pF) plus or minus 
appro.ximately 1 0 percent. This may advantageously decrease 
the amount of power drawn by the module and increase the 
maximum operating fiiequency of the module for a given 

55 memory transaction. 

Additionally, by decoupling the memory devices from sys- 
tem memory bus 323 and system memory controller 304, 
memory device 312-315 and 317-320 may operate torn 
reduced or different power supply voltages than those pro- 

60 vided to the balance of system 300. For example, memory 
devices 312-315 and 317-320 (and/or memory module con- 
trollers 310 and 316) may operate from power suppUes of 
approximately 1 .8 volts to 2.5 volts while the balance of the 
components in system 300 may operate at 3.3 volts or 5.0 

65 volts. This may also operate to decrease the amotmt of power 
drawn by the module and thus by system 300. Additionally, 
the voltage swing of the signals on lines 330, 332, and 
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334-337 may be advantageously chosen to be small (e.g.» 
approximately 1 ,0 to 2. 0 volts) to further reduce power drawn 
by memory devices 312-315. 

Power may be further reduced for each memory device and 
for the system as a whole when a DLL is reqxiired to interface 
with system memory bus 323, The DLL may be included 
within memory module controller 310 rather than each of 
memory devices 312-315 as my have been required in con- 
ventional systems. 

For another embodimem, addriess lines 330, control lines 
332, and/or data lines 334-337 may be combined into a 
time-multiplexed bus coupled between memoiy devices 
312-215 and memory raodxile controller 310. 

The memory devices 312-315 and 317-320 may be any 
type of volatile or nonvolatile memory devices such as 
DRAMs» synchronous DRAMs (SDRAMs), Fast Page Mode 
DRAMs (FPM DRAMs), extended data out DRAMs (EDO 
DRAMsX Rambus DRAMs (RDRAM^' devices), synchro- 
nons or asynchronous static random access memoiy (SRAM) 
devices, read only memory (ROM) devices, programmable 
ROM (PROM) devices, erasable PROMs (EPROMs), electri- 
cally erasable PROMs (EEPROMs), flash memory devices, 
and the like. Each memory module may include different 
types of memory devices. For example, memory module 306 
may include SDRAMs and memory module 308 may include 
EDO DRAMs, or memory modiile 306 may include non\'ola- 
tile memory devices and memory module 308 may include 
volatile memory devices. 

FIG. 5 is a block diagram of memory module 500 that is 
one embodiment of memory module 306 configured as a 
DRAM memory module. Module 500 includes DRAM 
memory module controller 510 that provides an interface 
between DRAM devices 512-515 and system memory bus 
323. DRAM memory module controller 510 franslates 
memory transactions received from system memory bus 323 
and generates DRAM memory operations (e.g. write, read, 
prefetch, refresh) including addresses on address bus 516, 
data signals on data lines 523-526, and control signals such as 
write enable WE on line 518, RAS on line 520. and CAS on 
line 522. DRAM memory module controller 510 may also 
provide additional control signals to DRAMs 512-515 
including clock signals for synchronous operation (i.e., for 
SDRAMs), memory bank select signals, and/or chip selector 
chip aiable signals. DRAM memory module controller may 
also generate refresh commands, prefetch commands, and/or 
power management commands to DRAMs 512-515. 

FIG. 6 is a block diagram of memory module 600 that is 
one embodiment of memory module 306 configured as an 
SRAM memory module. Module 600 includes SRAM 
memory module controller 610 that provides an interface 
between SRAM devices 612-^15 and system memory bus 
323. SRAM memory module controller 610 translates 
memory transactions received from system memory bus 323 
and generates SRAM memory, operations (e.g., write, read, 
reset, power down) including addresses on address bus 616, 
data signals on data lines 623-626, and control signals such as 
chip select or chip enable CE on line 618, write enable WE on 
line 620, and output enable on line 622. SRAM memory 
module controller 610 may also provide additional control 
signals to SRAMs 612-615 irKluding clock signals for syn- 
chronous operation, burst control signals, interrupt signals, 
reset signals, write and read signals (e.g., for a first-in-first- 
oul FIFO device), power management signals, byte enable 
signals, and/or expansion signals, 

FIG. 7 is a block diagram of memory module 700 that is 
one embodiment of memory module 307 configured as a 
nonvolatile memory module. Module 700 includes nonvola- 
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tile memory module controller 710 that provides an interface 
between nonvolatile devices 712-715 and system memory 
bus 323. Nonvolatile memory module controller 710 trans- 
lates memory transactions received from system memory bus 

5 323 and generates nonvolatile memory operations (e.g ., write 
or program, read, reset, power down, erase, etc.) including 
addresses on address bus 716, data signals on data lines 
723-726. and control signals such as chip select or chip 
enable CE on line 718, write enable WE on line 720, output 

10 enable on Ime 722, and a programming voltage on line 728. 
Nonvolatile memory modxile controller 710 may also provide 
additional control signals to nonvolatile memory devices 
712-715 including clock signals for synchronous operation, 
burst control signals, reset signals, power management sig- 

1 5 nals, or other signals or commands. 

With reference again to FIG. 3, system memory controller 
304 and memory module controllers 310 and 316 may com- 
municate using any number of protocols as previously men- 
tioned. In general, these protocols may be multiplexed such 

20 that some or all of the address, control, and data information 
is sent over the same bus lines of system memory bus 323. 
Alternatively, the protocols may be demultiplexed as shown 
in FIG, 3 with the data transmitted over a separate data bus 
from address and control information. Whether the protocol 

25 is multiplexed or demultiplexed, the protocol may also be 
coupled or decoupled. That is, the protocol may be coupled if 
the system memory controller sends its memory transactions 
to system memory bus 323 at a first point in time and expects 
the requested data (in the case of a read transaction) or an 

30 acknowledgment signal at a second point in time (i.e., a timed 
response). The protocol may be decoupled by using a hand- 
shaking or valid signal to indicate the start of a memory 
transaction or to indicate when valid data is transmitted to 
system memory bus 323 by system memory controller 304 of 

33 memory module controllers 310 or 316. 

FIG. 8 is a block diagram of memory module controller 
800 that is one embodiment of memory module controller 
310 using a time multiplexed protocol One embodiment of a 
time multiplexed protocol may be the Base and Concurrent 

40 Rambus'"^ protocols . Other protocols may be also be used. It 
will also be appreciated that memory module controller 800 is 
only one embodiment of a memory module controller. Other 
embodiments may also be used without departing from the 
spirit and scope of the present invention. 

4 5 Memory module controller 800 interfaces between system 
memory bus 823 that includes one or more clock signal lines 
824, a transaction bus 826. and may optionally include a valid 
signal 828. The transaction bus 826 is a general purpose bus 
that may carry address, data, and control information for a 

30 memory transaction. Valid signal 828 is one or more hand- 
shaking signals that may be used for a decoupled protocol to 
indicate the start of a memory transaction or to indicate when 
valid data is present on transaction bus 826. Vahd signal 828 
may be monitored and generated by handshake logic 806 

55 under the control of control logic 802. Valid signal 828 may 
be omitted for a coupled protocol. Memory module controller 
800 also interfeces with memory devices on a memory mod- 
ule (as in FIG. 3) by providing a clock signal 830, address 
signals 832, control signals 823, and data signals 836. Clock 

60 signal 830 may be omitted for asynchronous memory 
devices. 

Memory module controller 800 includes request handling 
logic 804 for interfacing with transaction bus 826. Request 
handling logic 804 may include deserializing logic that may 
65 separate the multiplexed control, address, and data inforrna- 
tion provided on transaction bus 826 and provide these sig- 
nals to control logic 802 via hues 838. 840. and 842. respec- 
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lively. Request handling logic 804 may also include 
serializing logic that may serialize control, address, and data 
information on lines 838, 840, and 842, respectively, into a 
time-multiplexed series of signals to be provided to transac- 
tion bus S26. 

Control logic 802 is the intelligence of memory module 
controller 800» and generates the appropriate control, 
address, and data signals for the memory module memory 
devices in response to the signals received from request han- 
dling logic 804. Each memory module controller device in 
each module may have different control logic that may be 
implement a specific translation between the signal types and 
protocol on the system memory bus and the specific memory 
signals and protocol expected by the memory devices on the 
memory module. For example, control logic 802 may provide 
the appropriate address signals to address interface circuit 
818 via lines 844, the appropriate control signals to control 
interface circuit 820 via lines 846, and the appropriate data 
signals to data I/O circuitry 822 via lines 848. Hie interface 
circuits may iiiclude buffers and register elements to drive 
address 832, memory control signals 834, and data 836. 

Interface circuits 818, 820, and 822 may be clocked by a 
clock signal generated by clock generator 810. Clock genera- 
tor 810 may also provide a clock signal to control logic 802 
and to clock buffers 816 wliich may drive clock signal 830 
and/or clock enable signals to memory devices on a memory 
module. Clock generator 810 may generate clock signals m 
response to clock 824 provided fi-om system memory bus 
823. CLK 830 may be a different frequency than clock 824. 
Memory module controller 800 or clock generator 810 may 
further include a DLL, clock buffer* or clock divider circuit 
that shapes or alters clock 824 before it reaches clock genera- 
tor 810. 

Memory module controller 800 may also include a power 
manager unit 808 that, under the control of control logic 802, 
may enable or disable clock generator 810. This may, in turn, 
enable or disable clock 830 or a clock enable signal provided 
to the memory devices on a memory module so as to control 
power dissipated by the memory devices. 

Memory module controller 800 may further include 
refresli logic 814 and prefetch logic 812. Under the control of 
control logic 802, refifesh logic 814 may send refresh control 
signals to memory devices on a memory module via control 
interface circuit 820. Control logic 802 may generate the 
refresh command at an appropriate time, or it may generate a 
rcfiiesh conmiand in response to a refresh command sent over 
transaction bus 826 from system memory controller 304. 
Prefetch logic 812 may, under the control of control logic 802, 
prefetch a page of data from memory devices (e.g., DRAM 
devices) and store the prefetched data for use in memory read 
transactions. 

Memory module controller 800 may fiirther include serial 
presence detect circuitry, ECC circuitry, current calibration 
circuitry, and other circuitry tliat may be removed from either 
the system memory controller or from the memory devices to 
reduce the compleAity of the designs of these parts. This may 
reduce the number of pins on the system memory controller. 

FIG. 9 shows a flow chart that illustrates one embodiment 
of the operatioii of memory module controller 800 for write 
and read transactions. The process may be a pipelined process 
or implemented a single stage process. It will be appreciated 
that menjory module controller 800 may perform many more 
functions besides translating write and read transactions 
between a system memory controller and memory devices on 
a memory module. 

The process starts at step 902- At step 904, memory module 
controller 800 receives a memory transaction request on 
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fransaction bus 826. Data handling logic 804 deseriahzes the 
transaction at step 906 to obtain the address, control, and data 
information of the transaction. At step 908, control logic 802 
inspects the deserialized information and determines if the 

5 transaction is directed to a memory device of the module 
controlled by memory module controller 800. This may be 
accomplished by inspecting the memory address received to 
see if it corresponds to an address occupied by one of the 
memory devices in the memory module. If the transaction is 

10 not directed to a memory device controlled by memory mod- 
ule controller 800, the process returns to step 902. If the 
transaction is directed to a memory . device controlled by 
memory module controller 800, control logic 802 determines 
what type of transaction is requested at step 910. If the trans- 

13 action is a write transaction, control logic 802 generates the 
appropriate write control signals (e.g., WE* CS, etc.) at step 
912 and provides these signals to control interface circuit 820. 
At step 914, control logic 802 then provides the write data in 
the appropriate data format to data I/O circuitry 822 and the 

20 address of the selected memory device to address interface 
circuit 818. The write data may be buffered in a write buffer 
(not shown). Hie data may then be written into the desired 
memory location of the selected memory device. At step 916, 
an optional acknowledge signal may be sent back to the 

25 system memory controller after the write operation is com- 
pleted. The process then returns to step 902. 

If the transaction is a read transaction, control logic 802 
then provides the read address of the selected memory device 
to address interface circuit. At step 920 control logic 802 

30 generates the appropriate read control signals (e.g., WE, CS, 
OE, etc.) and provides these signals to control interface cir- 
cuit 820. The data may then be read from the desired memory 
location of the selected memory device. The read data may be 
buffered in a read buffer (not shown), stored in control logic 

35 802 , or registered. At step 922 , the read data may be provided 
to request handling logic 804 where it is seriaUzed and may be 
framed by other data including, for example, a request num- 
ber indicating this particular read transaction. At step 924, the 
read data may then be sent back to the system memory con- 

40 troUer when system memory bus 823 is fiee or when all other 
previous transactions have been completed. For one embodi- 
ment, handshake logic 806 or other logic (e.g., request han- 
dling logic 804, control logic 802, or other bus monitoring 
logic) may monitor the activity on system memory bus 823 

45 and indicate to control logic 802 when it is the turn o f memory 
module controller 800 to send its read data to the system 
memory controller on hvs system memory bus 823. The read 
data may be sent back with valid signal 828 in a decoupled 
system. The process then returns to step 902. 

50 FIG. 10 is a block diagram of memory module controller 
1000 that is one embodiment of memory module controller 
310 using a demultiplexed protocol. One embodiment of a 
demultiplexed protocol may be Direct Rambus'rw protocol- 
Other protocols may be also be used. It will also be appreci- 

55 ated that memory module controller 1000 is only one embodi- 
ment of a memory module controller. Other embodiments 
may also be used without departing from the spirit and scope 
of the present invention. 
Memory module controller 1000 interfaces between sys- 

60 tern memory bus 1023 that includes one or more clock signal 
lines 1024, a command and address bus CMD/ADDR 1026, 
data bus 1027, and may optionally include a valid signal 
1028. CMD/ADDR bus 1026 may carry both address and 
control information for a memory transaction. Alternatively. 

65 CMD/ADDR bus 1026 may be separated into separate com- 
mand and address btises. Valid signal 1028 is a handshaking 
signal that may be used for a decoupled protocol to indicate 
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the start of a memory transactioii or to indicate when valid 
data is present on transaction bus 1026. Valid signal may be 
monitored and generated by handshake logic 1006 under the 
control of control logic 1002. Vahd signal 1028 may be omit- 
ted for a coupled protocol. Memory module controller 1000 3 
also interfaces with memory devices on a memory module (as 
in FIG. 3) by providing a clock signal 1030, address signals 
1032, control signals 1023, and data signals 1036. Clock- 
signal 1030 may be omitted for asynchronous memory 
devices. lo 

Memory module controller 1000 includes request handling 
logic 1004 for interfacing with transaction bus 1026. Request 
handling logic 1004 may include deserializing logic that may 
separate the multiplexed control and address information pro- 
vided on CMD/ADDR bus 1026 and provide these signals to 1 3 
control logic 1002 via lines 1042 and 1044, respectively. 
Request handling logic 1004 may also include seriahzing 
logic that may seriaUze control and address information on 
lines 1042 and 144, respectively, into a series of signals to be 
provided to CMD/ADDR bus 1026. 20 

Memory module controller 1000 further includes data han- 
dhng logic 1046 tliat may receive data from data bus 1027, 
reformat the data into a format appropriate for the memory 
devices of the memory module and provide the reformatted 
data to write buffer 1012. For one embodiment, data handling 23 
logic 1046 may include deserializing or unpacking logic to 
perform the translation between, for example, a narrow (e.g., 
16bit)data bus 1027andawider(e.g., 64 bit)memory device 
data bus 1036. The data may be stored in vmxc buffer 1012 
until it needs to be provided to a memory device via data I/O 30 
circuitry 1022. A corresponding address for the write data 
may be stored m address storage unit 1014. For an alternative 
embodiment, write buffer 1012 may be omitted. Data han- 
dling logic 1046 may also receive data from the memory 
devices of a memory module via data I/O circuitry 1022 35 
and/or read buffer 1038. Data handling logic may then refor- 
mat the data into a format expected by the protocol of system 
memory bus 1023. For one embodiment, data handling logic 
1046 may include serializing or packing logic to perform the 
translation between, for example, a wider (e.g., 64 bit) 4o 
memory device data bus 1036 and a narrower (e.g., 16 bit) 
data bus 1027. For yet another embodiment, data handling 
logic may be omitted and the formatting of data may be 
performed by control logic 1002. 

Control logic 1002 is the intelligence of memory module a 5 
controller 1000, and provides the appropriate control, 
address, and data signals for the memory module memory 
devices in response to the signals received fjiom request han- 
dling logic 1004. Each memory module controller device in 
each mode may have different control logic that may be 50 
implement a specific translation between tlie signal types and 
protocol on the system memory bus and the specific memory 
signals and protocol expected by the memory devices on the 
memory module. For example, control logic 1002 may pro- 
vide the appropriate address signals to address interface cir- 55 
cuit 1018 via lines 1048, the appropriate control signals to 
control interface circuit 1020 via lines 1050, and the appro- 
priate data signals to data I/O circuitry 1022 by controlling 
write buffer 1012 via line 1052 and address storage 1014 via 
Unes 1054. Control logic 1002 may also provide the appro- 60 
priate control signal to read buffer 1038 to control when data 
read from a memory device on a memory module is provided 
to data handling logic 1046. The interface circuits may 
include buffers and register elements lo drive address 1032, 
memory control signals 1034 and data 1036. <S5 

laterfece circuits 1018. 1020, and 1022 may be clocked by 
a clock signal generated by clock generator 1010. Clock 



generator 1010 may also provide a clock signal to control 
logic 1002 and to clock buffers 1016 which may drive clock 
signal 1030 and/or clock enable signals to memory devices on 
a memory module. Clock generator 1010 may generate clock 
signals in response to a clock signal provided by DLL 1058. 
DLL 1058 may receive on or more clock signals 1024 pro- 
vided from system memory bus 1023. CLK 1030 may be a 
different frequency than clock 1024. 

Memory module controller 1000 may also include a power 
manager unit 1008 that, under the control of control logic 
1002 may enable or disable the clock generator. This may, in 
tiun, enable or disable clock 1030 or a clock enable signal 
provided to the memory devices on a memory module so as to 
control power dissipated by these memory devices. 

Memory module controller 1000 may optionally include 
address storage unit 1040 coi^led to control logic 1002, 
address interface circuit 1018, and optionally to clock gen- 
erator 1010. Address storage 1040 may be used to store 
address information that may be provided fhDm CMD/ADDR 
1026. 

Memory module controller 1000 may further iuclude 
refresh and prefetch logic as illustrated in FIG. 8 which oper- 
ates under the control of control logic 1002. Memory module 
controller 1000 may fiirther include serial presence detect 
circuitry, ECC circuitry, current calibration circuitry, and 
other circuitry that may be removed from either the system 
memory controller or from the memory devices to reduce the 
complexity of the designs of these parts. This may reduce the 
number of pins on the system memory controller, 

FIG. 1 1 shows a flow chart that illustrates one embodiment 
of the operation of memory module controller 1000 for write 
and read transactions. The process may be a pipelined process 
or unplemented a single stage process. It will be appreciated 
that memory module controller 1000 may perform many 
more functions besides translating write and read transaction 
between a system memory controller and memory devices on 
a memory module. 

The process starts at step 1102. At step 1104. memory 
module controller 1000 receives a memory transaction 
request on CMD/ADDR bus 1026. At step 1006, data han- 
dling logic 1004 unpacks or deserializes the command and 
address information and transmits this information to control 
logic 1002. At step 1106, control logic 1002 mspects the 
unpacked or deserialized information and determines if the 
transaction is directed to a memory device in the module 
controlled by memory module controller 1000. This may be 
accomplished by inspecting the memory address received to 
see if it corresponds to an address occupied by one of the 
memory devices in the memory module. If the transaction is 
not directed to a memory device controlled by memory mod- 
ule controller 1000, the process returns to step 1102. If the 
transaction is directed to a memory device controlled by 
memory module controller 1000, control logic 1002 deter- 
mines what type of transaction is requested at step 1110. If the 
transaction is a write transaction, control logic 1002 generates 
the appropriate write control signals (e.g.. WE, CS, etc.) at 
step 1112 and provides these signals to control interface 
circuit 1020. Request handling logic 1004 may also provide 
the write address to address storage 1014. Alternatively, con- 
trol logic 1002 may provide the write address to address 
interface circuit 1018, for example, when write buffer 1012 is 
not used. At step 1 1 14, data handling logic 1046 accepts write 
data from 1027. unpacks or deserializes the write data, and 
provide the write data to write buffer 1012. At step 1116, the 
write data is provided in the appropriate data format to data 
I/O circuitry 1022. The data may then be written into the 
desired memory location of the selected memory device. At 
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Step 1118. an optional acknowledge signal iftay be sent back 
to the system memory controller after the write operation is 
completed. The process then returns to step 1102. 

If the transaction is a read transaction, control logic 1002 
generates the appropriate read control signals (e.g., WE, CS, ^ 
OE, etc.) at step 1120 and provides these signals to control 
interface circuit 1020. At step 1122, control logic 1002 then 
provides the read address of the selected memory device to 
address interface circuit 1018. The data may then be read 
from the desired memory location of the selected memory 
device. The read data may be buffered in read buffer 1038, 
stored in control logic 1002, or registered. At step 1124, the 
read data may be provided to data handling logic 1046 where 
it is serialized or packed and may be framed by other data i5 
including, for example, a request number indicating this par- 
ticular read transaction. At step 1126, the read data may then 
be sent back to the system memory when the system memory 
bus is free or when all other previous transactions have been 
completed. For one embodiment, handshake logic 1006 or 
other logic (e.g., request handling logic 1004, data handling 
logic 1046, control logic 1002, or other bus monitoring logic) 
may monitor the activity on system memory bus 1023 and 
indicate to control logic 1002 when it is the turn of memory 25 
module controller 1000 to send its read data to the system 
memory controller on bus system memory bus 1023. Valid 
read data may be sent back with valid signal 1028 in a 
decoupled system. The process then returns to step 1102. 

FIG, 12 is a block diagram of memory module 1200 that is 
one embodiment of memory module 306 of FIG, 3. Memory 
module 1200 is an SDRAM module that includes SDRAM 
devices 1204-1207 and memory module controller 1202. 
Memory module controller 1202 provides a bridge between 35 
system memory bus 1242 using a Direct Rambus'^ protocol 
(and coupled to a system memory controller) and SDRAM 
devices 1204-1207. The Direct Rambus'^ protocol includes 
clock signals CLK 1228, /CLK 1230 (where the symbol 
indicates a complementary signal), data lines 1232, row '^^ 
address lines 1234, and column address lines 1236. The data 
may include 16 signals lines, the row address may include 3 
signal lines, and the column address may include 5 signal 
lines as described in the Advance Information Direct 45 
RDRAM^< 64/72-Mbit (256Kxl6/18xl6d) data sheet. For 
one embodiment, CLK 1228 and /CLK 1230 may have a 
frequency-of approximately 400 MHz. Other signals used by 
this protocol are not shown so as not to obscure the present 
invention. 

Memory module controller 1202 provides memory trans- 
actions received from system memory bus 1242 to SDRAMs 
1204-1207, For one embodiment, SDRAMs 1 204-1207 may 
be 64 Mb SDRAMs such a s described in the preUminary data 55 
sheet of IBM*s IBM0364804C, IBM 0364 164C, 
IBM0364404C, and IBM03644B4C products published in 
November 1 997. Other SDRAMs may also be used. 

Memory module controller 1202 provides first control 
information to SDRAMs 1204 and 1205 over control bus **** 
1238, and second control information to SDRAMs 1206 and 
1207 over control bus 1240. Control bus 1238 may include a 
clock signal CLK 1208, a clock enable signal CKE 1209, a 
write enable signal WE 1210, a colunin address strobe signal 
CAS 1211, a row address strobe RAS 1212, and one or chip 
select signals CS 1213, Similarly, control bus 1240 may 



include a clock signal CLK 1216, a clock enable signal CKE 
1217, a write enable signal WE 12 18, a colrnnn address strobe 
signal CAS 12 19, a row address strobe RAS 1220, and one or 
chip select signals CS 1221. For one embodiment, the fre- 
quency of the CLK 1208 and CLK 1216 may be approxi- 
mately 1 GO MHz to 200 MHz. Other frequencies may be used. 
Memory module controller also conamunicates memory 
address signals SDRAMs 1204 and 1205 via address bus 
1214, and to SDRAMs 1206 and 1207 via address bus 1222. 
For one embodiment, each address bus may include 12 
address lines and an additional two bank select lines for 
selecting banks of memory in each SDRAM device. In an 
alternative embodiment, control bus 1238 and 1240 may be 
the same bus as shown in FIG. 3. Similarly, address buses 
1214 and 1222 may be tbe same bus. Memory module con- 
troller also conmiimicates read and write data with SDRAMs 
1204. 1205, 1206, and 1207 via signal lines 1224, 1225, 1226, 
and 1227, respectively. For one embodiment, each group of 
signal lines may include 1 6 data lines. 

FIG. 13 shows one embodiment of a process implemented 
by memory module controller 1202 to perform a read trans- 
action from one or more of SDRAMs 1 204- 1207 after receiv- 
ing a read request from system memory bus 1242. FIG. 13 is 
desaibed with the aid of tlie exemplary timing diagram of 
FIG. 14. It will be appreciated that FIG. 14 shows CLK 1228 
having approximately twice the frequency of CLK 1208. For 
one embodiment, CLK 1228 may have a frequency of 
appro.ximately 400 MHz and CLK 1208 may have a fre- 
quency of approximately 200 MHz. For other embodiments, 
different ratios of frequencies, and/or different frequencies, 
may be used. 

Memory module controller 1202 may implement the pro- 
cess of FIG. 13 using the circuitry shown m memory module 
1000 of FIG. 10. For example, CLK 1024 corresponds to 
CLK 1228, CMD/ADDR 1026 corresponds to row 1234 and 
column 1236, data 1027 corresponds to data 1232, CLK 1030 
corresponds to CLK 1208, address 1032 corresponds to 
address 1214, memory control signals 1034 corresponds to 
control bus 1238, and data 1036 corresponds to data 1224. For 
other embodiments, other circuitry may be used to implement 
the process of FIG. 13. 

The process starts at step 1302. At step 1304 and from time 
tO to time tl, an activate command is sent on row lines 1234 
including a device, bank, and row address of selected memory 
locations in one or more of SDRAMs 1204-1207. At step 
1306 and from time t2 to time t3, data request logic 1004 
deserializes tlie command and address information and pro- 
vides this information to control logic 1002. Control logic 
1002 then provides the row address to the selected SDRAMs 
over address bus 1214 and/or 1222, and the appropriate bank 
activate command to the selected SDRAMs over control bus 
1 238 and/or 1240. For one embodiment, the appropriate bank 
activate command includes disabling CAS lines 1211 and/or 
1219 and WE lines 1210 and/or 1218, and enabling CS lines 
1213 and/or 1221 and RAS lines 1212 and/or 1220 at the 
rising edge of CLK 1208 and/or 1216. 

Because tbe memory addressing scheme protocol used by 
Direct RDRAM^ devices may be di fiferent than that used by 
the selected SDRAMs, the activate command supplied on row 
address lines 1234 may include column address information 
for the selected SDRAMs. In this example, this colunm 
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address information may be stored in address storage unit 
1040 xintil such time that the column address information is 
issued to the selected SDRAMs. 

At step 1308 and from time t4 to time t6, a read command 
is sent on column lines 1236. The read command includes ^ 
device, bank, and column address information for the desired 
read location in the selected SDRAMs . At step 1310 and fixjm 
time t6 to time t7, request handling logic 1004 deserializes the 
read command and provides this information to control logic ] o 
1002. Control logic 1002 tlien provides the column address 
and the read command to the selected SDRAMs over address 
bus 1214 and/or 1222 and over control bus 1238 and/or 1240, 
respectively. For one embodiment, the appropriate read com- 
mandincludes disablingRAS hnes 1212 and/or 1220 and WE 
lines 1210 and/or 1218, and enabling CS lines 1213 and/or 
1221 and CAS lines 1211 and/or 1219 at the rising edge of 
CLK 1208 and/or CLK 1216. 

If there is a difference between the number of bytes 20 
selected in the selected SDRAMs and the number of bytes 
expected from a single read transaction by the system 
memory controller, then steps 1 308 and 1310 may be repea ted 
a desired number of times to match the number of bytes. For 
example, as shown in FIG. 14, if the first read command 
READl on column 1236 (together with the activate com- 
mand on row 1234) addresses 1 6 bytes of data and the read 
command to the selected SDRAMs addresses 32 bytes of 
data, then a second read command READ2 may be issued 
flx>m time t6 to time t9 to address the second 16 bytes. 

At step 131 2 and from time t8 to time tl5, data I/O circuitry 
1022 may receive data read from the selected SDRAMs. For 
example, 32 bytes of data may be read from the four 
SDRAMs 1204-1207 in the following manner: from time t8 33 
to time tlO data I/O circuitry 1022 may receive data packet 
DO that includes the first eight bytes, two bytes from each of 
the four SDRAMs 1204-1207; from time tlO to time tl2 data 
packet Dl that includes the second eight bytes, two bytes 
from each of the four SDRAMs; from time tl2 to time tl3 
data packet D2 that includes the third eight bytes, two bytes 
from each of the four SDRAMs; and, from time tl3 to time 
tl4 data packet D3 that includes the last eiglit bytes, two bytes 
from each of the four SDRAMs. It will be appreciated that for 45 
other embodiments a di fferent number o fbytes and a diflerent 
number of cycles may be required to read the selected data 
from the selected SDRAMs. 

Wlien the read data is received, it niay be stored in read 
buffer 1038 prior to providing the data to data handling logic 
1046. Alternatively, it may be provided directly to data han- 
dling logic 1046. At step 1314, data handling logic may 
serialize or pack the data into the proper format expected by 
the system memory controller on data bus 1232. For one 55 
embodiment, data packets DO and Dl, including a total of 1 6 
bytes of data from SDRAMs 1 204-1 207, may be packed into 
one iminterrupted transmission DATAl that may provided to 
data bus 1232 at step 1316 and from time til to time tl5. 
Similarly, data packets D2 and D3, including a second 1 6 *° 
bytes of data from SDRAMs 1204-1207 may be packed into 
one uninterrupted transmission DATA2 that may provided to 
data bus 1232 at step 1316 and firom time tl4 to time tl6. 

FIG. IS shows one embodiment of a process implemented 55 
by memory module controller 1202 to perform a write trans- 
action to one or more of SDRAMs 1204-1207 afler receivmg 
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a write request £h)m system memory bus 1242. The same 
process may be used to write data to any of the SDRAMs. 
FIG. 15 is described with the aid of the exemplary timing 
diagram of FIG. 16. Memory module controller 1202 may 
implement the process of FIG. 13 using the circuitry shown in 
memory modiUe 1000 of FIG. 10. 

It will be appreciated that FIG. 15 shows CLK 1228 having 
approximately twice the frequency of CLK 1208. For one 
embodiment, CLK 1228 may have a frequency of approxi- 
mately 400 MHz and CLK 1208 may have a frequency of 
approximately 200 MHz. For other embodiments, different 
ratios of frequencies, and/or different frequencies, may be 
used. 

The process starts at step 1502. At step 1504 and from time 
to to time tl, an activate command is sent on row lines 1234 
including a device, bank, and mw address of memory loca- 
tions in one or more of selected SDRAMs 1 204-1207 . At step 
1506, data request logic 1004 deserializes the command and 
address information and provides this information to control 
logic 1002. 

Because the memory addressing scheme protocol used by 
Direct RDRAMT™ devices may be different than that used by 
SDRAMs 1204-1207, the activate command supplied on row 
address lines 1234 may include column address information 
for the selected SDRAMs. In this example, this column 
address information may be stored in address storage unit 
1040 until such time that the column address information is 
issued to the selected SDRAMs. 

At step 1508 and from time t2 to time t3, a write command 
is sent on column lines 1236. The write command includes 
device, bank, and column address information for the desired 
write locations in the selected SDRAMs. At step 1510, 
request handling logic 1004 deserializes the write command 
and provides this information to control logic 1002. If there is 
a difference between the number of bytes selected for writing 
in the selected SDRAMs and the number of bytes selected by 
the system memory controller, then steps 1508 and 1510 may 
be repeated a desired numba: of times to match the nimaber of 
bytes. For example, as shown in FIG. 16, if the first write 
command WRITEl on column 1236 (together with the acti- 
vate command on row 1234) selects 1 6 bytes of data and the 
write command to the selected SDRAMs addresses 32 bytes 
of data, then a second write command WRrrE2 may be issued 
from time t3 to tune t4 to address the second 16 bytes. 

At step 1512 and from time t5 to time t6, data handUng 
logic 1046 may receive write data DATAl from data biis 1232 
and may unpack or deserialize the write data. Data handling 
logic 1046 may store the write data DATAl into write buffer 
1012, and address storage 1014 may store the write address 
output by request handling logic 1004. If a subsequent write 
or read command is received, control logic 1002 may inspect 
write buffer 1012 and address storage 1014 for the requested 
address. If the address is located in address storage 1014, then 
the coiresponding data in write buffer 1012 may be read or 
overwritten. If a subsequent write command WRITE2 is 
issued, then DATA2 received from time t8 to time tlO, and 
associated with this command, may be mipacked or deserial- 
ized and a Iso stored in write buffer 1012, 

At step 1516 and from time t6 to time t7, control logic 1002 
then provides the row address to the selected SDRAMs over 
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address bus 1214 and/or 1222, and the appropriate bank acti- 
vate command to the selected SDRAMs over control bus 
1238 and/or 1240. For one embodiment, the appropriate bank 
activate command includes disabling CAS lines 1211 and/or 
1219 and WE lines 121Q and/or 1218. and enabling CS lines 
1213 and/or 1221 and RAS lines 1212 and/or 1220 at the 
rising edge of CLK 1208 aud/or CLK 1216. At step 1518 and 
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selected memory locations in SDRAMs 1204-1207. In this 
embodiment, tlie activate command may be spread over two 
cycles(i.e.»cycleOandcyclel in Table 1 below)ofCLK 1228 
in which data is transferred on each clock edge of the CLK 
1228 (i.e., double-pumped). For one embodiment the packet 
fonnat is as shown in T^ble 1 where RQ[7:0] correspond to 
the signal lines of control bus 1235. 



TABLE I 



cycle 


RQ[7] 


RQ[6] 


RQ[5] 


RQt4] 


RQPl 


RQ[2] 


RQ[1] 


RQ[0] 


0 


ST 


SF 


D[4] 


Dt3] 


D[2) 


D[!l 


DtO] 


B[0] 


0 


R[<S] 


RC5I 


R[4J 


R(3] 


R[2J 




RtO] 


B{1] 


1 


R(13) 


R[121 


R[ll] 


R[10] 


R[9] 


R(8] 


R[7] 


B[21 



from time t9 to time tl 1 , control logic 1002 then provides tlie 
column address and the write command to the selected 
SDRAMs over address bus 1214 and/or 1222 and control bus 
1238 and/or 1240, respectively. For one embodiment, the 
appropriate write conmiand includes disabling RAS lines 
1212 and/or 1210 and enabling CS lines 1213 and/or 1221, 
RAS lines 1212 and/or 1210, and WE lines 1210 and/or 1218 
at the rising edge of CLK 1208 and/or CLK 1216. 

At step 1520 and from time t9 to time tl4, control logic may 
cause the write data to be provided to the selected SDRAMs 
on data lines 1224, 1225, 1226, and/or 1227 from data I/O 
circuitry 1022. For example, 32 bytes of data may be written 
to the four SDRAMs 1204-1207 in the following manner: 
from time t9 to time til data I/O circuitry 1022 may provide 
data packet DO including the first eight bytes, two bytes to 
each of the four SDRAMs; and from time ill to tune tl2 data 
packet Dl including the second eight bytes, two bytes to each 
of SDRAMs 1204-1207. DO and Dl may correspond to 
DAL\L Additionally, from time tl2 to time tl3 data I/O 
circuitry 1022 may provide data packet D2 including the third 
eight bytes, two bytes to each of SDRAMs 1204-1207, and 
from time tl3 to time tl4 data packet D3 including the last 
eight bytes, two bytes to each of SDRAMs 1204-1207. D2 
and D3 may correspond to DATA2 . It will be appreciated that 
for other embodiments a different number of bytes and a 
different nmnber of cycles may be required to write the 
selected the data to the selected SDRAMs. Although in this 
example all DRAMs are written to, in alternative embodi- 
ments a partial write to one (or less than all) of the SDRAMs 
may be executed. 

In an alternative embodiment, memory module controller 
102 may also provide a bridge between system memory bus 
1242 and SDRAMs 1204-1207 using a modified protocol. 
The modified protocol may be demultiplexed having a data 
bus and a separate control bus that transmits control informa- 
tion and address between a system memory controller (e.g., 
system memory controller 304 of FIG. 3) and memory mod- 
ule controller 1202. 

In this embodiment, a read transaction from one or more of 
SDRAMs 1204-1207 maybe performedas shown in FIG. 17 
wherein row bus 1234 and column bus 1236 are used as one 
control bus 1235 having eight signal lines. For other embodi- 
ments, a different number of signal lines may be used. 

From time tO to time tl, an activate conunand is sent on 
control bus 1235 including a device, bank, and row address of 



The activate command includes several fields: 
B[2:0] Bank Select: Selects one of eight banks in SDRAMs 
1204-1207; 

D[4:0] Device Select: Selects one of 2* or 32 memory 
module controllers; 

R[13:0] Row Address: Provides a row address for one or 
more locations selected in SDRAMs 1204-1207; and 

ST, SF Encoded Frame/Fast Command: Bits used to indi- 
cate whether a conunand is framed as indicated in Table 
2- The Extended commands may include noop, pre- 
charge, refresh, and other commands. 



TABLE 2 



ST 


SF 


operation 


0 


0 


No Framing 


0 


1 


Frame an Active Command (page 






activate) 


1 


0 


Frame a Read/Write Command 






(page hit) 


1 


1 


Frame an Extended Command 



From time t2 to time t3, data request logic 1004 deserial- 
izes the command and address information and provides this 
information to control logic 1002. Control logic 1002 then 
provides the row address to the selected SDRAMs over 
address bus 1214 and/or 1222, and the appropriate bank acti- 
vate command to the selected SDRAMs over control bus 
1238 and/or 1240 (e.g., as described above with respect to 
FIGS- 13 and 14). 

From time t4 to time t5, a read command is sent on control 
bus 1235. The read command includes device, bank, and 
column address information for the desired read locations in 
the SDRAMs. In this embodiment, the read command may be 
spread over two cycles (i.e., cycle 0 and cycle 1 in Table 3 
below) of CLK 1228, and have a packet format as shown in 
Table 3. 
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TABLE 3 



Cycle RQ[7] 


RQ[6] 


RQ13] 


RQ[4J 


RQ[3] 


RQ[2] 


RQIH 


RQ[0] 


0 ST 


SF 




Dt31 


D[2] 


D[l] 


D[0] 


B[0] 


0 C[<5] 


C[3] 


Ct4] 


C[3J 


C[2] 


C[l] 


C(01 


C[l] 


1 AP 


R/W 


ctn] 


cm 


C[P] 


C[8] 


C17] 


C[2] 



The read command includes several different fields not 
present in the activate comniand: 

C[ 1 1 :0] Row Address: Provides a column address for one 

or more locations selected in SDRAMs 1204-1207; 
R/W Read Write: indicates whether tlie command is a read 

transaction or a write transaction. When this signal is in 

one logical state it indicates a read transaction, and when 

it is in the complementary logic state it indicates a write 

transaction; and 
AP Autoprecharge: Indicates whether the selected column 

(or row) of selected memory cells should be prechaiged 

after reading. 

From time t6 to time t8, request handling logic 1004 dese- 
rializes the read command and pro\ades this information to 
control logic 1002. Control logic 1002 then provides the 
column address and the read conunand to the selected 
SDRAMs over address bus 12 14 and/or 1 222 and over control 
bus 1238 and/or 1240, respectively, (e.g., as described above 
with respect to FIGS. 13 and 14). If the first read command 
READl on control bus 1235 addresses less bytes of data and 
the read command issued to SDRAMs 1204-1207, then a 
second read conmiand READ2 may be issued from time t7 to 
timet9. 

From time tlO to time tl6, data I/O circuitry 1022 may 
receive data read from the selected SDRAMs. For example, 
32 bytes of data may be read from the four SDRAMs 
1204-1207 in the following manner: from time tl 0 to time tl 1 
data I/O circuitry 1022 may receive data packet DO that 
includes the first eight bytes, two bytes from each of the four 
SDRAMs 1204-1207; from time til to time tl2 data packet 
Dl tliat includes the second eight bytes two bytes from each 
of the four SDRAMs; from time tl3 to time tl4 data packet 
D2 that includes the third eight bytes, two bytes from each of 
the four SDRAMs; and, from time tl4 to time tl6 data packet 
D3 that includes the last eight bytes, two bytes from each of 
the four SDRAMs. It will be appreciated that for other 
embodiments a different number of bytes and a different 
number of cycles may be required to read the selected data 
from the selected SDRAMs. 

When the read data is received,- it may be stored in read 
buffer 1038 prior to providing the data to data handling logic 
1046, Alternatively, it may be provided directly to data han- 
dling logic 1046. At step 1314, data handling logic may 
seriahze or pack the data into the proper format expected by 
the system memory controller on data bus 1232. For one 
embodiment, data packets E>0 and Dl, including a total of 16 
bytes of data Bx^m SDRAMs 1204-1207, noay be packed into 
one uninterrupted transmission DATAl that may provided to 
data bus 1232 from time tl2 to time tlS. Similarly, data 
packets D2 and D3, including a second 1 6 bytes of data from 
SDRAMs 1204-1207 may be packed into one uninterrupted 
transmission DATA2 that may provided to data bus 1232 from 
time tl5to time tl7. 

For this embodiment, a write transaction to one or more of 
SDRAMs 1204-1207 may be performed as shown in FIG. 18. 
From time tO to time tl, an activate command as shown in 
Table 1 is sent on control bus 1235 including a device, bank. 



and row address of memory locations in one or more of 
SDRAMs 1204-1207, Data request logic 1004 deserializes 
the command and address information and provides this 
information to control logic 1002. 

From time t2 to time t3, a write command is sent on control 
bus 1235 that includes device, bank, and column address 
information for the desired write locations in SDRAMs 
1204-1207. The write command uses the packet format 
shown in Tbble 3 with the R/W bit set appropriately to indi- 
cate a write transaction. Request handling logic 1004 deseri- 
^° alizes the write command and provides this information to 
control logic 1002. If there is a difference between the number 
of bytes selected for writing in SDRAMs 1 204-1207(e.g„ 32 
bytes) and the number of bytes selected by the smgle write 
transaction issued by the system memory confroller (e.g., 16 
bytes), then the first write command WRTTEl on control bus 
1235 may write a first amount (e.g., 16 bytes) of data, and a 
second write command WRITE2 may be issued from time t4 
to time t5 to write a second amount of data (e.g., another 16 

From time t6 to time t9, data handlmg logic 1046 may 
receive write data DATAl from data bus 1232 and may 
unpack or deserialize the write data. Data handling logic 1046 
may store the write data DATAl into write buffer 1012, and 
address storage 1014 may store the write address output by 
request handling logic 1004, If a subsequent write or read 
command is received, control logic 1002 may inspect write 
buffer 1012 and address storage 1014 for the requested 
address. If the address is located in address storage 1014, then 
the corresponding data in write buffer 1012 may be read or 
overwritten. If a subsequent write command WRrrE2 is 
issued, then DATA2 received from time t9 to time til, and 
associated with this command, may be unpacked or deserial- 
ized and also stored in write buffer 1012. 

45 From time t7 to time t8, control logic 1002 then provides 
the row address to the selected SDRAMs over adciress bus 
1214 and/or 1222, and the appropriate bank activate com- 
mand to SDRAMs 1204-1207 over control bus 1238 and/or 
1240 (e.g.. as described above with respect to FIGS. 15 and 

50 16). From time tU to tkne tl2, control logic 1002 then pro- 
vides the colunm address and the write command to the 
selected SDRAMs over address bus 1214 and/or 1222 and 
over control bus 1238 and/or 1240, respectively (e.g., as 
described above with respect to FIGS. 15 and ,16). 

55 From time tlO to time tl5. control logic may cause the 
write data to be provided to the selected SDRAMs on data 
lines 1224. 1225, 1226, and/or 1227 from data I/O circuitry 
1022. For example, 32 bytes of data may be written to the four 
SDRAMs 1204-1207 in the following manner: from time tlO 

60 to time tl2 data I/O circuitry 1022 may provide data packet 
DO including the first eight bytes, two bytes to each of the four 
SDRAMs; and from time tl2 to time tl3 data packet Dl 
including the second eight bytes, two bytes to each of 
SDRAMs 1204-1207. DO and Dl may correspond to 

65 DATAl. Additionally, from time tl3 to time tl4 data VO 
circuitry 1022 may provide data packet D2 including the third 
eight bytes, two bytes to each of SDRAMs 1204-1207, and 
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fiom time tl4 to time tl5 data packet D3 including the last 10. A system, comprising: 

eight bytes, two bytes to each of SDRAMs 1204-1207. D2 a memory interconnect; 

and D3 may correspond to DArA2. It will be appreciated that a system memory controller coupled to the memory inter- 

for other embodiments a different number of bytes and a connect; and 

different number of cycles may be required to write the 5 a first memory module coupled to the memory intercon- 

selected the data to the selected SDRAMs. Although in this nect, the first memory module including 

example all DRAMs arc written to, in alternative embodi- a first plurality of memory devices and 

ments a partial write to one (or less than all) of the SDRAMs a first memory module controller coupled to the first 

may be executed. plurality of memory devices and the memory inter- 

Although the present invention has been described in terms i o connect to receive a memory request signal from the 

of specific embodiments, it will be appreciated that various system memory controller via the memory intercon- 

modifications and alterations might be made by those skilled nect, 

in the art without departing from the spirit and scope of the in response to the memory request signal, the first 

invention. The invention should therefore be measured in memory module controller, to generate a separate 

terms of the claims which follow, i5 signal addressed to and to be serviced by at least one 

of the plurality of memory devices in a manner inde- 

What is claimed is* pendent of any difference of signal impedance or 

1. A method, comprising: operating voltage between the memory devices and 

. . ^ ^ . „ ^ the system memory mterconnect. 

receivmg at a memory module controller of a memory a. The system of claim 10, wherein the first memory 
modulehavmgapluraUtyofmemoryde\acesamemory module controller fiirther comprises a clock generator to gen- 
request signal ftom a system memory controller over a ^^^^ ^ ^^^^^ ^^^^^ separate signal, wherein the 
system memory mterconnect; and ^^^^ ^^g^^^ different than a clock signal of the memory 

in response to the memory request signal, causing the interconnect, 
memory module controller to generate a separate signal 25 12. The system of claim 11, wherein first memory module 
addressed to and to be serviced by at least one of the controUerfurthercomprises a request handling logic to exam- 
plurality ofmemory devices in a manner independent of tiie memory request to determine whether the memory 
any difference of signal impedance or operating voltage request is addressed to at least one of the memory devices and 
between the memory devices and the system memory to ignore the memory request if the memory request is not 
mterconnect. 3q addressedtoany of the memory devices. 

2. The method of claim 1, further comprising generating a 13. The system of claim 12. wherein the first memory 
separateclocksignalviaaclockgeneratorwithinthememory module controller further comprises a power management 
module controller to drive the separate signal, the separate xxnit to control a power supphed to the memory devices, 
clock signal being different than a clock signal of the system 14. Tlie system of claim 13, wherein the first plurality of 
memory interconnect, 35 memory devices and the memory interconnect operate at 

3. The method of claim 1, further comprising; different powa* voltages, 

examining the memory request signal to determine 15, The system of claim 13, wherein the power manage- 

whether the memory request signal is addressed to at ment unit reduces at least a portion of the power to the 

least one of the memory devices of the respective memory devices, if the memory request is not addressed to 

memory module; and 40 any of the memory devices. 

bypassing the memory request signal if the memory 16. The system of claim 13, wherein the first memory 

request signal is not addressed to any of the memory module controller further comprises a control logic coupled 

devices ofthe memory module. to the request handling logic, the clock generator, and the 

4. The method ofclaim 3, further comprising reducing at POwer management unit, the control logic configured to 
least a portion of a power associated with the plurality of decouple the memory devices from the memory mterconnect 
memory devices if thememory r^uest signal is not addressed the memory request is not addressed to any ofthe memory 
to any of the memory devices. devices. 

5. The method ofclaim 3, further comprising reducing a ^ 17. The system ofclaim 16, whcijin in response to a signal 
frequency of the separate clock signal with respect to tiie ^^"^ request hancUmg logic mdicamig that ttie memory 
pluJaUty of memory devices if the memory requ^signal is ^^f"^ of the memory devices, the 
not addressed to any ofthe memory devices. control logic mstructs the clock generator to alter a fre^^^ 

in. *u J r 1 • ^ c -.u -J 1- of the clock signal to the memory devices. 

6. The method of clami 3, further compnsmg decouplmg ^^^^ therein the control logic 
the plurahty of memory devices fxom the system memory •ms\nxcts the power management unit to disable the 
mterconnect if the memory request signal is not addressed to ^^^^ ^^^^^^ -^^^^ ^ ^ is not addressed to any 
any of the memory devices, such that the plurahty ofmemory the memory devices, which in turn reduces the power 
devices rcmam mactive, dissipation ofthe memory devices. 

7. The method of claim 3, fimher comprising providing the 19 -fhe system ofclaim 10, further comprising a second 
separate clock signal and power to the memory devices ofthe memory module coupled to the memory interconnect, the 
memory module only if the memory request signal is second memory module including: 

addressed to at least one of the memory devices. ^ second plurality ofmemory devices and 

8. The method ofclaim 1 , wherein the plurality ofmemory a second memory module controller coupled to the second 
devices and the system memory controller operate at different plurality of memory devices and the memory intcrcon- 
power voltages. nect, the second memory module controller managing 

9. The method ofclaim 1. wherein the plurality ofmemory 65 the second plurality ofmemory devices independent of 
devices and the memory controller operate at different oper- the first memory module controUer ofthe first memory 
ating fiequcncy signals having different voltage swings. module and the second memory module controller sepa- 
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rating the second plurality of memory devices of the 
second memory module &om the system memory con- 
troller and the memory interconnect. 
20, The system of claim 19, wherein the first plurality of ^ 
memory devices and the second plurality of memory devices 
have different signaling protocols, which are controlled by 



24 



the first and second memory module controllers respectively, 
and wherein the different signaling protocols of the first and 
second pluralities of memory devices are incompatible with 
signaling protocols required by the systemmemory controller 
and the memory interconnect. 



